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SPECIFICATION 

Electronic Version 1.2.8 
Stylesheet Version 1 .0 

METHOD FOR CAMERA 
CALIBRATION AND QUALITY 

TESTING 

Background of Invention 

[0001] The present invention relates generally to cameras and more particularly to a 
method for testing cameras for automotive applications. 

[0002] Automotive systems have substantially increased the use of cameras in recent 
history. Applications such as blind spot warnings, pedestrian recognition, adaptive 
cruise control and driver recognition all require cameras that operate under various 
lighting conditions. Automotive cameras should provide sufficient contrast resolution 
under the aforementioned conditions. 

[0003] Difficulties with current camera applications often occur when a portion of a scene 
is brightly lit while another portion of the scene is shadowed. Two examples of this 
are when the sun is in the field of view or at night when headlights of other vehicles 
are within the field of view. Currently, there are no effective methods of testing 
camera quality for the aforementioned examples. There are however methods of 
detection experiment methodology used for evaluating contrasting conditions of an 
object, such vehicle camouflage. 

[0004] Manufacturer specifications typically contain information such as lowest operable 
light level and resolution. However this information is usually insufficient for 
characterizing cameras for automotive applications. Most low light cameras perform 
well when an entire scene is dark but provide almost no contrast when there is a 
bright object in the scene. This lack of contrast tends to make many cameras 
unsuitable for automotive use. 
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[0005] The disadvantages associated with current methods of qualifying cameras for 
automotive systems have made it apparent that a new camera applicability testing 
method for automotive systems Is needed. This new method should determine which 
cameras are most appropriate for automotive systems under high glare conditions. 

Summary of Invention 

[0006] Cameras applied to automotive systems should ideally provide contrast resolution 
under varied lighting conditions. The present invention substantially simulates a view 
of oncoming night traffic and gives a quantitative measure of the resolving ability of 
the camera as the lighting is varied. 

[0007] The present Invention incorporates detection experiment methodology used for 

evaluating vehicle camouflage and gives a quantitative measure of the resolving ability 
of a camera as lighting Is varied. 

[0008] In accordance with one aspect of the present invention, a method for testing 

cameras comprising: positioning a first camera such that an image of a first target is 
displayed on a monitor substantially within at least one default image parameter; 
engaging a first dimming condition of a first light source from said first camera, 
thereby generating a first lighting condition signal; receiving said first lighting 
condition signal In said first camera; displaying said first lighting condition signal on 
said monitor; analyzing said first lighting condition signal; engaging a second 
dimming condition of said first light source from said first camera, thereby generating 
a second lighting condition signal; displaying said second lighting condition signal on 
said monitor; and analyzing said second lighting condition signal. 

[0009] 

In accordance with another aspect of the present invention, a camera testing 
system including a first target is disclosed. A first light source is adapted to generate 
a first light signal. A first camera is aligned a remote distance from the first target and 
is adapted to receive the first light signal. A first dimming component is adapted to 
engage a first dimming operation to dim the first light signal, thereby generating a 
first lighting condition signal. The first dimming component is further adapted to 
engage a second dimming operation to dim the first light signal thereby generating a 
second lighting condition signal. A monitor is adapted to receive the first lighting 
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condition signal and the second lighting condition signal and consecutively display the 
lighting condition signals substantially within at least one default image parameter. 

[0010] Additional objects and features of the present Invention will become apparent 

upon review of the drawings and accompanying detailed description of the preferred 
embodiments. 

Brief Description of Drawings 

[001 1] For a more complete understanding of the invention, there will now be described 
some embodiments thereof, given by way of example, reference being made to the 
accompanying drawings, in which: 

[0012] FIGURE 1 is an aerial view of a method for testing cameras according to one 
embodiment of the present Invention; 

[001 3] FIGURE 2 is a frontal view of FIGURE 1 ; 

[0014] FIGURE 3 is an alternate embodiment of FIGURE 1 according to one embodiment of 
the present invention; and 

[001 5] FIGURE ^ is a block diagram of a method for testing cameras according to one 
embodiment of the present invention. 

Detailed Description 

[0016] The present Invention is illustrated with respect to a camera testing system, 
particularly suited to the automotive field. However, the present invention is 
applicable to various other uses that may require cameras as will be understood by 
one skilled in the art. 

[0017] 

Referring to FIGURES 1 and 2, a camera testing system 1 0, including a first target 
12, in accordance with one embodiment of the present invention, is illustrated. A first 
camera 14 is aligned a remote distance from the first target 12. The first camera 14 
receives a first light signal generated from a first light source 16, here embodied as a 
light bulb 1 7 and a reflective surface 1 8. A first dimming component 1 9 is engaged to 
initiate a first dimming condition of the first light source 16 from the first camera 14 
thereby generating a first lighting condition signal. The monitor 20 displays an image 
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21 of the lighting condition signal, which is viewed by at least one observer 22, or as 
illustrated, a group of observers. 

[001 8] The size of the first target 1 2, e.g. USAF Tribar, is such that it is substantially 

resolvable In normal lighting. Alternate embodiments of the present Invention include 
a second target or a plurality of targets, as will be understood by one skilled in the 

[001 9] The first camera 1 4 is aligned a remote distance from the first target 1 2 and is 

focused thereon. The first camera 14 receives a first light signal generated from a first 
light source 1 6. 

[0020] The first light source 16 is embodied as a standard 60-watt light bulb 1 7 placed 
in front of a reflective surface 1 8, for example a white sheet of paper, half the 
distance between the first target 1 2 and the first camera 1 4. Alternate embodiments 
of the first light source 16 include spotlights or other light sources known in the art. 

[0021] The first dimming component 19 is engaged to initiate a first dimming condition 
of the first light source 16 from the first camera 14, thereby generating a first lighting 
condition signal. The first dimming component 19 also Initiates a second dimming 
condition of the first light source 1 6 from the first camera 14, thereby generating a 
second lighting condition signal. For alternate embodiments, the dimming component 
1 9 varies the light Intensity to generate a set of dimming conditions. 

[0022] The first dimming component 1 9 is further adapted to Initiate a dimming 

condition of the aforementioned second light source. Further dimming conditions are 
initiated depending on the desired number of statistical data points. 

[0023] The embodied first dimming component 19 includes a moveable glare shield and 
a dimming mechanism to dim the light sources. Typical dimming mechanisms include 
manually operated dimming switches, control circuits, or any other device designed to 
incrementally reduce light from the first light source 16. 

[0024] 

The monitor 20 receives an image of the first target 1 2 from the first camera 14. 
The remote distance between the first camera 1 4 and the first target 1 2 is tailored 
such that an image displays on the monitor 20 substantially within at least one default 
image parameter. The monitor 20 further displays the first lighting condition signal 
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and the second lighting condition signal. The remote distance between the first 
camera 1 2 and the first target 1 2 is further adapted such that the image displays on 
the monitor 20 within a set of default image parameters. 

[0025] The remote distance between the first camera 1 4 and the first target 1 2 is tailored 
such that the image displays on the monitor 20 substantially within at least one 
default image parameter. Alternate embodiments include a set of default image 
parameters for increased calibration accuracy, as will be understood by one skilled in 
the art. 

[0026] One embodiment of the aforementioned set of default parameters includes the 
distance D from the first camera 14 to the first target 12 determined through 
observing the image 21 on the monitor 20 and adjusting the distance D until the first 
target 1 2 appears 1 /4 the height of the monitor 20 and the center 24 of the first 
target 12 appears 1 /3 of the monitor width from the right hand edge 26 of the 
monitor 20. The aforementioned default parameters frame a similar viewable scene 
for the first camera 14 and successive cameras regardless of the camera field of view, 
as will be understood by one skilled in the art. 

[0027] The observer 22, or a group of observers, views and analyzes the image 21 of the 
first target 1 2 from the first camera 1 4. 

[0028] Camera performance under varying light conditions is assessed by progressively 
dimming off the image of the first light source 1 6, as viewed by the first camera 1 4 
and recording the response from, for example, four observers as to how detectable 
the first target 1 2 appears on the monitor 20. The observers categorize the visibility 
of the first target 1 2 In terms of detectabillty levels. 

[0029] An embodiment of the detectabillty levels Includes: 0. Nothing Is resolvable; 1. 

Something is resolvable; 2. Two separate groups of something are resolvable; 3. One 
group of three bars Is clearly resolvable; 4. Both horizontal and vertical bars are 
clearly resolvable. 

[0030] The present invention is directed to a test for checking camera performance in 
situations havmg varied light levels through substantially simulating an oncommg 
traffic view at night. 
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[0031] Referring to FIGURE 3, an alternate embodiment of FIGURE 1 is illustrated. The 

targets 32, 34 in this embodiment are illustrated in a cubby hole arrangement with a 
divider 36, approximately one meter in length, which facilitates the application of 
dramatically different light levels on the targets 32, 34. The targets 32, 24 are 
illuminated by 1 50-watt spotlights 38, 40 acting as the light source and having 
brightness changed through dimming mechanisms in the form of Individual variable 
transformers 42, 44. The distance from the tested camera 46 to the targets 32, 34 is 
adjusted as in FIGURE 1 . 

[0032] The tests begin with both targets 32, 34 illuminated at a level sufficient enough to 
allow resolution of both targets 32, 34. The light level on the first target 34 is held 
constant during the experiment while the light on the second target 32 is increased 
until the resolution degrades. The light level Is measured at the targets 32, 34 with, 
for example, a photometer, as will be under stood by one skilled in the art. 
Progressive degradation as the light level at the second target 32 is increased is 
reported by the observers 48 and recorded using the 0 to 4 embodiment of 
detectability levels. The light levels at that target 32, 34 are recorded when a 
transition in detectability is reported by a majority of observers 48. 

[0033] The present invention yields a relationship between detectability and light level as 
the Illumination on the second target 32 is increased beyond the optimum level. 
Varying the incident light level in detectability increments generates detailed 
characterization data for tested cameras. This data is important for automotive 
applications because it is otherwise difficult to achieve control over scene lighting or 
achieve optimal conditions in a laboratory setting. 

[0034] Referring to FIGURE 4, a block diagram of a method for testing cameras in 

accordance with one embodiment of the present invention, is illustrated. The test 
starts in operation block 50 where the camera is positioned in view of the first target 
and the light source within monitor default parameters. 

[0035] Operation block 52 then activates, and the blocking condition is engaged. A glare 
shield then progressively blocks the first camera view of the light source. The 
resultant lighting condition is then received by and displayed on the monitor in 
operation block 54. 
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[0036] Operation block 56 then activates, and observers are asked to assess the 

detectability of the target for 20%, 40%, 60%, 80% and 100% dimming of the light 
source. Light levels at the first camera and the first target are measured for each test 
with a photometer. 

[0037] ANOVA, or an alternate statistical analysis, is then conducted to determine 

significant differences between the cameras tested, as will be understood by one 
skilled in the art. Because the detectability of the targets is measured on an ordinal 
scale, a rank transformation is performed on the original data. 

[0038] A determination is then made in inquiry block 58 whether a sufficient amount of 
data has been collected to determine camera quality. For a negative response, 
operation block 52 reactivates. Otherwise, block diagram logic ends. 

[0039] Important to note is that the aforementioned block diagram is run for several 

cameras successively, and statistical data points from the cameras are compared to 
determine which camera or cameras are within automotive parameters, as will be 
understood by one skilled in the art. 

[0040] In operation, a plurality of cameras are tested such that an image of at least one 
target is displayed on a monitor substantially within at least one default image 
parameter for each consecutive camera of the plurality of cameras. Lighting conditions 
received by each consecutive camera of the plurality of cameras are varied, thereby 
generating lighting condition signals. Each consecutive camera receives the respective 
lighting condition signals and displays them on the monitor. A group of observers 
then assesses detectability of the lighting condition signals according to a set of 
discrete detectability levels, and the statistical variance between each consecutive 
camera is calculated. 



[0041] 



An alternate embodiment of the present invention includes positioning the first 
camera such that an Image of the first target is displayed on the monitor substantially 
within at least one default image parameter. Following the positioning step, the 
dimming mechanism is activated to vary the lighting condition receivable by the first 
camera, thereby generating a first set of lighting condition signals. The first set of 
lighting condition signals is received in the first camera and displayed on the monitor. 



App_ID= 10064769 



Page 



^ n run, .« \i -i?" n-z, r^a r% -^j n z'.':^ 



A group of observers then assess detectability of the first set of lighting condition 
signals according to a set of discrete detectability levels. 

[0042] The aforementioned method is subsequently engaged for further cameras. In 

other words, the second camera is positioned such that the image of the first target is 
displayed on the monitor substantially within the previously mentioned default image 
parameter. The lighting condition receivable by the second camera is varied, thereby 
generating a second set of lighting condition signals. The second set of lighting 
condition signals are received in the second camera and displayed on the monitor. 
The group of observers then assess detectability of the second set of lighting 
condition signals according to the set of discrete detectability levels and calculate 
statistical variance between the first camera and the second camera. The method 
presented in the current embodiment is designed for comparison of numerous 
numbers and types of cameras, as will be understood by one skilled in the art. 

[0043] While the invention has been described in connection with one or more 

embodiments, it should be understood that the invention is not limited to those 
embodiments. On the contrary, the invention covers all alternatives, modifications, 
and equivalents, as may be included within the spirit and scope of the appended 
claims. 
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